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Abstract 

The “scenario approach” provides an intuitive method to address chance constrained problems arising in 
control design for uncertain systems. It addresses these problems by replacing the chance constraint with a 
finite number of sampled constraints (scenarios). The sample size critically depends on Helly’s dimension, 
a quantity always upper bounded by the number of decision variables. However, this standard bound can 
lead to computationally expensive programs whose solutions are conservative in terms of cost and violation 
probability. We derive improved bounds of Helly’s dimension for problems where the chance constraint 
has certain structural properties. The improved bounds lower the number of scenarios required for these 
problems, leading both to improved objective value and reduced computational complexity. Our results 
are generally applicable to Randomized Model Predictive Control of chance constrained linear systems with 
additive uncertainty and affine disturbance feedback. The efficacy of the proposed bound is demonstrated 
on an inventory management example. 


1. Introduction 

Many problems in systems analysis and control synthesis can be formulated as optimization problems, 
including Lyapunov stability, robust control, and Model Predictive Control (MPC) problems [1„ [21 SI HI 0 - 
In reality, most systems are affected by uncertainty and/or disturbances, in which case a control decision 
should be made that accounts for these uncertainties. In robust optimization, one seeks a solution satisfying 
all admissible uncertainty realizations (worst-case approach). Unfortunately, robust programs are in general 
difficult to solve |>], and computational tractability is often obtained at the cost of introducing conservatism. 
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Stochastic optimization offers an alternative approach where constraints are interpreted in a probabilistic 
sense as chance constraints, allowing for constraint violations with limited probability [7j. Except for special 
cases, chance constrained problems are also intractable, since they generally are non-convex and require the 
computation of high-dimensional probability integrals. Randomized methods are tools for approximating 
the solutions to such problems, without being limited to specific probability distributions. By replacing 
the chance constraint with a finite number of randomly sampled constraints, the fundamental question in 
randomized algorithms is how large to choose the sample size to guarantee constraint satisfaction with high 
confidence. One approach is based on the Vapnik-Chervonenkis (VC) theory of statistical learning [8J, which 
has been studied widely for control applications Hi- In general, however, statistical learning theory comes 
with high sample complexity and consequent conservatism da Section 1.2]. Recently, a new randomized 
method known as the “scenario approach” has emerged, which is applicable whenever the sampled program 
is convex mm, and which has been successfully exploited for control design, both theoretical and applied, 
see e.g. da QH EG2 HE]. Compared to methods based on the theory of statistical learning, the sample size 
required by the scenario approach is typically much lower [TUI Section 1.2], 

The sample size bounds provided by the scenario approach are based on the notion of Helly’s dimension 
|12l Definition 3.3], which is always upper bounded by the number of decision variables [12, Lemma 2.2]. 
Since the sample size bound grows linearly in Helly’s dimension IH Corollary 5.1], finding better bounds 
not only reduces conservatism of the solution, but also allows problems to be solved faster. Unfortunately, 
computing Helly’s dimension for a given problem is often challenging. To the best of the authors’ knowledge, 
the only attempts to obtain improved bounds are the works in m [T5] . It is shown in El that Helly’s 
dimension can be upper bounded by the so-called support rank (s-rank), obtained by exploiting structural 
properties of the constraints in the decision space. Under certain technical assumptions, the authors of [T8] 
upper bound Helly’s dimension by the number of active constraints, which can applied for cases where the 
constraint functions are affine in the uncertainty variables. 

In this paper, we propose new methodologies for bounding Holly’s dimension that exploit additional 
structure in the constraint functions. We first establish bounds for generic problems where the constraint 
functions are separable in the decision and uncertainty variables. We then exploit these structures for cases 
where the constraint functions depend affinely and quadratically on the uncertainty variables. The derived 
sample size depends on the dimension of the uncertainty space , hence complementing El and generalizing 
those in m- Furthermore, we also show explicitly that for the considered problems the scenario approach 
together with our bounds always provides lower sample sizes than the corresponding ones based on the VC 
theory of statistical learning. 

The paper is organized as follows: Section [2] establishes the problem setup and presents the technical 
background. In Section [3] we present the case when the constraint function exhibits a structured dependence 
on the uncertainty. We compare the new sample sizes obtained with existing methods in Section[4] In Section 


2 


[5j we apply our bounds to Randomized MPC problems, and present numerical results for an inventory 
management problem. Finally, Section [6] concludes the paper. 

2. Problem Description and Technical Background 

Let S £ A C be a random variable defined on a probability space (A, JF, P), where A is the sample 
space, F a a -algebra on A, and P the probability measure defined on J. We consider chance constrained 
problems (CCPs) of the form 

! min c T x 

ze* (1) 

s.t. P [g(: r, 8) < 0] > 1 — e, 

where X C K” is a compact convex set, x £ K" the decision variable, g : K™ xA->K the constraint function, 
e £ (0,1) the acceptable violation probability, and c £ R" the cost vector. We consider the scenario program 
(SP) associated with CCP(e), where the chance constraint in ([l]) is replaced by N sampled constraints, 
corresponding to independent identically distributed (i.i.d.) realizations ..., £ A of the uncertainty 

vector 8 HMD]: 

! min c T x 

xGX ( 2 ) 
s.t. g(x, 8^) < 0 Vj £ {1,..., N}. 

We refer to u := ..., 6^} £ A N as a multi-sample. Throughout this paper, we make the following 

assumption. 

Standing Assumption 1 (Regularity). For almost all <5 £ A, the function x H > g(x 1 S) is convex and lower 
semi-continuous. For any integer N, SP[w] in ([2]) is almost surely feasible; its optimizer exists and is unique 
for almost all realizations of a; £ A N . For all x £ X, the mapping S i—>• g{x,5) is measurable. 

Standing Assumption [I] is standard in the scenario approach m Assumption 1], jT2j Assumptions 1, 2], 
m Assumptions 1, 2], and [HE Appendix B]. The uniqueness requirement can be relaxed by adopting a 
suitable (strictly convex or lexicographic) tie-break rule [TOJ Section 4.1]. We refer to [12] Appendix B] and 
m for a technical discussion on measurability issues. 

Let us denote the (unique) minimizers of SP[w] and SP[w \ {5^}], for k £ {1,..., A}, by x* and x\, 
respectively. Our forthcoming results are based on the following two key definitions. 

Definition 1 (Support Constraint [TO, Definition 4]). The sample 5^ is called a support sample if c T x^ < 
c T £*; in this case the corresponding constraint g(-,S^) is called a support constraint for SP[u;]. The set of 
support constraints of SP[w] is denoted by sc(SP[u;]). 

We denote by |sc(SP[u;])| the cardinality of the set of support constraints. 
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Definition 2 (Helly’s dimension HU Definition 3.1]). Helly’s dimension of SP[w] in ([2]) is the smallest 
integer £ such that 

ess sup |sc(SP[w])| < C 
UIG A N 

holds for any finite N > 1. 

Helly’s dimension thus is the maximum number of support constraints |sc(SP[w])| for any possible real¬ 
ization of a multi-sample. Intuitively, the SP in ([2]) can be used to approximate the CCP in Q. Indeed, 
the authors of mm show that if the sample size N satisfies 

(3) 

3=0 V J ' 

for some [3 € (0,1), then, with confidence at least 1 — /3, the optimal solution of SP[w] is feasible for the 
original CCP(e) QjSJ Theorem 3.3]. It was shown in T2J Lemma 2.2] that Helly’s dimension ( is always 
upper bounded by n. This standard bound (( < n), however, is only tight for fully-supported problems [Til 
Theorem 1], but remains conservative otherwise. 

The overall goal of this paper is to find tighter upper bounds on Helly’s dimension £ for non-fully- 
supported problems, which would allow for smaller N than the one given by the standard bound. Following 
m one can show that ([3| is satisfied if N is chosen such that 

N ~1 1 + ln (/?)) ' ^ 

Since e is typically chosen small in many practical applications (e.g. 10 _1 ~ 10 -4 ) and N roughly scales 
as (D(£/e), finding a good bound on £ is key for reducing the required sample size. A small sample size is 
attractive mainly for two reasons: less conservative solutions in terms of cost, and reduced computational 
time for solving the scenario program in <§• Also, a small N is beneficial for cases in which the extraction 
of samples is itself costly. 

2.1. Bounding Helly’s dimension 

Unfortunately, explicitly computing £ is in general very difficult. Tighter bounds on Helly’s dimension 
were introduced in HZI. based on the so-called support rank (s-rank). It is defined as the dimension n of 
the decision space minus the dimension of the maximal linearly unconstrained subspace m Definition 3.6], 
and is therefore never worse than the standard bound. As shown in U3 Example 3.5], the s-rank can be 
explicitly computed if g(x,5) is affine or quadratic in the decision variable x, and hence in some cases can 
lead to a significant reduction in the sample size N. 

There are, however, cases where the s-rank yields no improvement upon the standard bound, although 
the exact Helly’s dimension is much lower. Consider, for instance, 

{ min h 

(5) 

s.t. P [|| Ay — 6|| + 6 < h] > 1 — e, 
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where || • || is any norm, S £ R is a continuous random variable, A £ R fcx ( n_1 ) has full column rank and 
b £ R fc . The s-rank for the above problem is n, because A is full column rank. Hence, the s-rank does not 
improve upon the standard bound on Hclly’s dimension, resulting in the same bound £ < n. However, by 
exploiting structural dependence of the constraint function on the uncertainty, we will show in Section |3.2| 
that the number of support constraints of any SP associated with the CCP in ([5]) is equal to 1 almost surely. 

More generally, this paper addresses the problem of upper bounding Helly’s dimension in the case g(x, S) 
does not offer enough structure in x for the s-rank to improve upon the standard bound. Unless stated 
otherwise, the proofs of all following statements can be found in Appendix A 


3. Structured Dependence on the Uncertainty 

We consider the case where the constraint function of the CCP in (JT|) is structured and vector-valued of 
the form g : R n x A —> R r , where we interpret the inequalities g(x,6) < 0 element-wise. All the definitions 
and results from the previous section carry over by considering the scalarized function max ie / 1) 5)}, 
where •) is the ith component of g(-, •). Let us now assume that g(-, •) has a separable (“sep” for short) 
structure of the form 

g(x , S) = g sep (x, S) := G(x) q(5 ) + H(x) + s(S), (6) 

where G : R" — > R rxm , q : A —» R m , H : R” —► R r , and s : A —> R r . The following statement contains the 
fundamental result of this paper. 

Lemma 1. Let g(x,5) be as in ©>■ Then |sc(SP[w])| < r(m + 1) almost surely. 

The proof relies on Radon’s Theorem and resembles proofs used in statistical learning theory when 
determining the VC-dimension of hyperplanes [SI Theorem 7.4.1]. Intuitively speaking, the result can be 
explained by introducing auxiliary optimization variables y\ := G(x ) £ R rxm and 2/2 := H(x) £ R r , implying 
that Helly’s dimension is upper bounded by r{m + 1), the total number of auxiliary optimization variables. 

3.1. Multiplicative dependence on the uncertainty 

Let us now consider the case in which the uncertainty q(S) enters multiplicatively in the constraints, that 
is 

g(x , (5) = g mu it (a, <5) := G(x) q{6) + s(S). (7) 

This is a special case of |6]) and can be obtained by setting H(x) = 0. Then the number of support 
constraints with g(x,S) = g m uit(^, (5) is bounded as follows. 

Proposition 1. Let g(x,8) be as in Q. Then |sc(SP[w])| < rm almost surely. 

Note that the results in Proposition [T] and Lemma [l] also hold if a constant vector a £ R r is appended 
in the constraint functions, e.g. g(x, S) = G(x) q(S) + s(S) + a. 
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3.2. Additive dependence on the uncertainty 

We consider now the case in which the uncertainty enters additively in the constraints, that is 

g(x,6) = g add {x,5) := H(x) + s(5). (8) 

Proposition 2. Let g(x,8) be as in Q. Then |sc(SP[w])| < r almost surely. 

Proof. Invoke Lemma a with G(x) = 0 in ([6]). □ 

The bound on the number of support constraints for the example in ([5]) is now readily derived from 
Proposition [2] with r = 1 and by realizing that the minimizer in © is finite and exists for all multi-sample 
realizations. 

3.3. Affine dependence on the uncertainty 

We now consider the special case where g(x, S) consists of r constraints, where each of them depends 
affinely on S. That is, with q(8) = S and for given G : R n —» R rxd and H : R" —» R r , we consider 

g(x, 8) = g a g(x, S) := G(x)8 + H(x). (9) 

Proposition 3. Let g{x,S) be as in ([9]). Then |sc(SP[w])| < Caff := r{d + 1) almost surely. 

Proof. Invoke Lemma [l] with q(S) = S , s(S) = 0, and m = d. □ 

Proposition [3] combined with (T2J Theorem 3.3] immediately leads to the following result. 

Theorem 1. Let g(x,S) be as in Q. For all e,/3 £ (0,1), if N satisfies ([3]) with r(d + l) in place off, then 
with confidence no smaller than l — (3, the solution o/SP[w] in ([ 2 ]) is feasible for CCP(e) in ([!]). 

Whenever r{d + 1) is lower than the s-rank, then our result improves on existing sample complexity 
bounds. 


3 . 4 . Quadratic dependence on the uncertainty 

We now extend the previous results to the case of quadratic mapping 5 1 —> g(x,5). Considering r > 1 
constraints, we have functions gi : 1“ x A -> I, with i £ {l,...,r}, defined as gi(x,S) := d T Ai{x)8 + 
bi(x) T 5 + Ci(x), where Ai : K n —>• R . dxd , bi : K ra —► K d , and Ci : K" —> R. Without loss of generality, for all 
i £ {1,..., r} and all x £ R n , we can assume Ai(x) = Aiix) 1 . Define now 


g(x,8) = g qua .d{x, S) := max gi(x,5). 


(10) 


Proposition 4. Let g(x, 6) be as in (fl0|). Then |sc(SP[w])| < C quad := rd(d + 3)/2 + r almost surely. 


It now follows immediately from m Theorem 3.3]: 
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Theorem 2. Letg(x,5) be as in ( 101. For all e £ (0,1) and [3 £ (0,1), if N satisfies (J3| with rd(d + 3)/2 + r 
in place of (, then with confidence no smaller than 1— /3, the solution o/SP[w] in ([2]) is feasible for CCP(e) 

in Q. 

If rd(d+3)/2 + r is smaller than the s-rank, then our sample complexity improves on all known bounds. 


3.5. Box constraints 

Let us now study the case in which the constraint function g(x,8 ) is subject to “box constraints”, i.e. 
g(x , 6) is simultaneously upper and lower bounded. Such structure typically appears in control applications 
where upper and lower bounds are imposed on states and inputs. It can be shown in this case that the 
bounds derived in the previous subsections still hold. We show this for g mu it{x, 6). 

Assuming that x H > g(x , i5) is affine almost surely and given two vectors g,g£ R r , consider the constraints 


9 < 3muit(a;, 8) < g , 


( 11 ) 


with g mn it(-, •) as in 0 - Then the following holds. 


Proposition 5. 

surely. 


Consider the constraints in (111 with </ m uit(v) ns in ([7]). 


Then |sc(SP[u;])| < rm almost 


It follows from the proof of Proposition [5] that similar results can be obtained if g sep (x,S), g a dd{x,8), 
g a s(x , (5) and g qu a d(£, 5) are box constrained, with the bounds r(m + 1), r, r(d + 1) and rd(d + 3)/2 + r, 
respectively. 


4. Discussion 

We first comment on the connection between our bound and the s-rank. Then, we discuss and compare 
our bound with other bounds. 

4-1. Connection to s-rank 

In general, the sample size bounds based on the s-rank and our derived bounds are not directly com¬ 
parable, since the former relies on structure in the decision space , whereas our bounds exploit structure 
in the uncertainty space. As shown in HU Example 3.5], the s-rank can be explicitly computed if g(x,8) 
is affine or quadratic in x, whereas our bounds are useful whenever g{x , 8) is affine or quadratic in 8 
(Theorems [T] and [2]). More specifically, the s-rank can be readily computed for constraints of the form 
(x — x c (8)) T Q(x — x c (8)) — r(8) < 0, while it is not trivial to do so for 8 T A(x)8 + b(x) T 8 + c(x) < 0, and vice 
versa. There are cases, however, where the s-rank and our bounds coincide. This is, for example, the case 
when the constraint function is bilinear in x and 8. In practice, the minimum of the s-rank and our bound 
should be taken to obtain a tighter bound on Helly’s dimension. We will come back to this in Section [5] 
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4-2. Comparison with Statistical Learning Theory 


A different randomized method for approximating CCP(e) is based on statistical learning theory 
It is applicable for constraint functions of the form ([9 ) and (10), in which case the sample sizes scale as 




where £ vc is a bound on the VC-dimensior 2 Specifically, known bounds for the VC-dimension 
are £]§ = 2r log 2 (er)(d+1) and £™ ad = 2r log 2 (er)(d(d +3)/2 + 1) [5]. From Propositions [3] and [4] it follows 
that < Caff an< 3 Cquad < Cquad f° r an y r an d Therefore, we conclude that our proposed sample sizes 
are lower than those based on statistical learning theory for these two cases. 

This is not surprising, since statistical learning theory can be applied to any (non-convex) optimization 
program with finite VC-dimension, whereas the scenario approach is typically restricted to random convex 
programs. However, we remark here that recent results related to scenario-based optimization have extended 
the standard (convex) scenario approach to certain classes of random non-convex programs, see e.g. dl EH 
for theoretical results and [33] for an application towards Randomized Nonlinear MPC. 


4-3. Connection to other results 

Scenario programs subject to constraints of form were recently studied in [IS] in the context of 
Randomized Model Predictive Control (RMPC). Under the (more restrictive) assumptions of an absolutely 
continuous probability distribution and that G(x*) ^ 0, it was shown that |sc(SP[w])| < rd , compared to 
r(d + 1) in Proposition [3j The result presented in this paper, however, applies to a wider range of problems, 
without any assumption on the underlying probability distribution, at the cost of a slight increase in the 
upper bound for Helly’s dimension. 

An alternative approach to approximate CCP(e) was proposed in [33], and studied in [35] [35] in the 
context of Stochastic MPC. The method is based on a combination of scenario and robust optimization. 
Similar to our results here, the sample sizes in [24| depend on the dimension of the uncertainty space. How¬ 
ever, since the method requires the solution of a robust problem, where the constraints need to be satisfied 
robustly for all uncertainty realizations inside a predefined set, the solutions can become substantially more 
conservative than the standard scenario approach, see e.g. [3J; Section V.C] and [35] Section V.B]. Nev¬ 
ertheless, recent results suggest that some conservatism can be overcome by using non-linear policies [25]. 
This issue is subject to future research. 


5. Randomized Model Predictive Control of Chance Constrained Systems 

In this section, we apply our new bounds to Randomized Model Predictive Control (RMPC) as a method 
for approximating chance constrained Stochastic MPC problems mmm- We consider linear systems of 


2 Recall that the sample size required by the scenario approach scales as 0(£/e). 






the form 


Xk +1 = Ax k + Bu k + ES k , 


where k £ {0 ,... ,T — 1} is the time index, T the prediction horizon, Xk £ is the state, Uk £ R"“ 

is the input, and 5k £ Ac is an uncertain disturbance. For given matrices G £ R"s xn “, g £ R ra s, 
F £ R n f xn * and / £ KW, we consider state and input constraints of the form Uk £ U := {it £ M n " : Gu < g} 
and Xk £ X := {x £ : Fx < /}, where n/ (n g ) is the number of state (input) constraints. We require 

the state constraints to be satisfied with probability at least 1 — e. To account for the uncertainties entering 
the system, we model the inputs using affine decision rules [29] (30]: 

k -1 


Uk(5) '— hk T 'y ' M k j5j, 

j—0 


( 12 ) 


where hk £ M n " and Mkj £ R n “ xn * are decision variables, 5 := [< 5 0 , • • •, 5t-i), and the (empty) sum is 


defined as ]C,=o(') := 0- Note that, to ensure causality, the input at time k depends only on the past 


disturbances So,..., 6k- 1 - We assume for (12) that S can be measured directly. As the control objective, 
any convex cost function J(u) can be chosen, where u := [w 0 , • • •, ut-i\- If Xq is the initial state, h := 
[ho ,..., hr- 1 ] and M £ t Tn “X Tn * is the collection of all { Mk,j}k,j , then the predicted state at stage k is 


x k (S) = A k x 0 + B fc h + (B fe M + E k )S 


( 13 ) 


for suitable matrices B^ £ R n * xTn u and E fc £ R n ^ xTn ^, The chance constrained MPC problem is now given 
as 


min J(M.h) (14) 

M,h v . / 

s.t. Uk(S) £ U V<5 £ A t , Vk £ {0,... ,T - 1}, 

P[x k (S) £X]>l-e Vk£ {1,...,T}, 


with Uk{5) as in (12) and Xk(S) as in (13). Note that we require the input constraints in (14) to be satisfied 
robustly for every uncertainty realization since they are typically inflexible. It is shown in [ 291 [30] that if A 
is a polytope, then the robust input constraints admit an exact reformulation as a set of linear constraints. 


The RMPC counterpart of (14) is obtained by replacing the chance constraints with sampled constraints 
as described next: for each stage k, we extract the multi-sample uJk := {5*- 1 !,..., S( N A}. Then the fcth 
chance constraint is replaced with Nk sampled constraints, each corresponding to a sample 5 M £ u>k- 
Clearly, the sample sizes Nk depend on the Helly’s dimensions of each stage, denoted by (k ■ 


5.1. Comparison of Bounds on Helly’s Dimension 

As reported in (25] Section III], the standard bound for (k is given by (j| td := kn u + n u ns , whereas 
the s-rank gives the bound C:= min {rank(F), kn u } + n u n$ k( ' k ~ 1 ' 1 [131 Proposition 1], Clearly, both 
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bounds scale quadratically in the number of stages as 0{k 2 n u ns). This renders the application of RMPC 
numerically challenging due to the large number of sampled constraints that need to be stored and processed 
when solving the problem. For example, 125] reports that when using these bounds, only small problems 
(n„ = ng = 1, T <20, e = 0.1) can be solved efficiently. 

In contrast, our new bound based on Proposition [3] suggests that (k < Cit ew ;= nf(kng + l) for the general 
case, and (k < Q ew := ^f(kng + 1) if the state constraints are just upper and lower bounded (Proposition 
|5]). Note that our new bound ££ ew scales linearly in the number of stages fc, and can therefore be applied to 
problems with a long horizon. Moreover, our bound does not depend on the number of inputs, but rather 
on the number of state constraints. The second column in Table [T] summarizes the different bounds. 


Table 1: Comparison of bounds on C,k for general chance constrained MPC of form (14) and the inventory 

where a := min {rank(F), kn u } . 


control example in Section 


5.2 


Bound on £k 

General MPC 

Inventory Control 

standard |1T| 

kn u + n u n s ( 2 ' 

0 (k 2 n u ) 

s-rank 17] 

fc(fc-i) 

a + n u ns 2 

0 (k 2 n u ) 

Proposition 3 

nf(kns + 1) 

O(k) 


5.2. Inventory Control Example 


As an example for (14), let us now consider an inventory management problem for a warehouse supplied 
by n u factories. The inventory dynamics are Xk+i = %k + 1 T Wfc — Vk — Sk , where Xk G M is the inventory 
level, Uk G the factory outputs, Vk G R. the nominal demand, 4 £ I the demand uncertainty, and 
1 g the all-one vector. Following [22], we let Vk = 300 (1 + 0.5sin(7rfc/12)). The demand uncertainties 
Sk are assumed to be i.i.d. random variables uniformly distributed on A= [—200,200]. We consider state 


and input constraints of the form P[500 < Xk\ > 1 — e and 0 < Uk < 567, with Uk as in (121, and minimize 
the cost J(u) = + kl T Uk] +E[100xt]- 


5.2.1. Bounding Helly’s Dimension 

Figure [l] depicts the bounds on the number of support constraints for the s-rank and the new bouncQ 
as a function of n u and k. It illustrates well the linear and quadratic growth of the s-rank with respect 
to the number of inputs and stages, respectively. In contrast, the new bound scales moderately along the 
stages, and is entirely independent of the number of inputs. Figure[l]also demonstrates that while the s-rank 


! The standard bound is not plotted since it is never better than the s-rank, see also Table 
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provides good bounds for small values of k and n u , it is outperformed by our new bound when these values 
become large. This asymptotic behavior is summarized in the third column of Table [l] This observation is 
indeed a typical behavior of these two bounds, and hold generally for RMPC problems of this kind. 



5.2.2. Empirical Confidence and Violation Probability 

For n u = 5 and T = 15, Figure [ 2 ] depicts empirical estimates of the confidence along the stages for 
both the s-rank and the new bound, while Figure [3] shows the empirical violation probability ik■ Note that, 
for reasons of computational tractability, different values e and /3 were used in the two figures. The sample 
sizes Af. used to generate both plots were acquired by numerically inverting @ with C, new and £f in place 
of £, respectively. 

Figures [2] and [3] show that the new bound is closer to the predefined confidence and violation probability 
levels (red) than the s-rank whenever k > 2, but that the s-rank outperforms the new bound only for k = 1. 
This is not surprising, since for k = 1, the s-rank provides a tighter bound on £1 than the new bound does, 
see also Figure [l] and Table [l] From these figures we conclude that for most stages, the new bound is less 
conservative than the s-rank, and therefore also the standard bound. 

5.2.3. Tightness of the Bounds 

Even if the new bound improves upon the existing ones, Figures [2] and [3] suggest they are still conservative. 
Indeed, the empirical violation probabilities ik can be improved using a so-called sampling-and-discarding 
method, in which a larger number of samples is drawn, but some of them are discarded a posteriori ED la¬ 
in general, this method not only improves the objective value, but also brings the empirical violation 
probability closer to the predefined level. Furthermore, we can improve the empirical confidence /3fc using 
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Figure 2: Predefined j3 (red), its empirical estimate using the s-rank (black) and the new bound (blue) for 
n u = 5, e = 0.2 and /3 = 0.1. The estimates are obtained from 10 4 instances, where for each instance the 
empirical violation probabilities are estimated by evaluating the solutions of each RMPC problem against 10 4 
uncertainty realizations. Then, /3 is determined as the fraction e which were higher than the predetermined 
level of e = 0.2. 



Figure 3: Predefined e (red), its empirical estimate using the s-rank (black) and the new bound (blue) 
for n u = 5, e = 0.1 and /3 = 10~ 7 . The estimates are obtained by averaging over the empirical violation 
probabilities of 10 3 instances, each estimated by evaluating its solution against 10 4 uncertainty realizations. 

the bound (£ ew = k instead of ££ ew = k + 1 from [TSJ Proposition 2], since both assumptions required there 
(absolutely continuous distribution and G(x *) ^ 0) are satisfied here. 
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6. Conclusion 


We presented a new upper bound on Helly’s dimension for random convex programs in which the con¬ 
straint functions can be separated between the decision and uncertainty variables. As a consequence, the 
number of scenarios can be reduced significantly for problems where the dimension of the uncertain variable 
is smaller than the dimension of the decision variable. This leads to less conservative solutions, both in terms 
of cost and violation probability, as well as a reduction in the computational complexity of solutions based on 
the scenario approach. We applied our bounds to Stochastic MPC problems for chance constrained systems, 
and demonstrated the quality of the bound on an inventory example. We believe that both theoretical and 
applied research in the field of Randomized MPC for uncertain linear systems can benefit from our results. 
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Appendix A. Proofs 

For ease of presentation we first show the proof of Proposition [I] and then the proof of Lemma |TJ 
Proof of Proposition [7] 

Let us first prove the following auxiliary statement. 

Claim. If r = 1, then |sc(SP[w])| < m. 

Proof. Consider SP[w] subject to A > m+ 1 sampled constraints, generated by u = {<5^,..., <5^ Ar) }. 
Suppose, for the sake of contradiction, that there exists m+1 support constraints. Without loss of generality, 
they are generated by the first m + 1 samples, i.e. sc(SP[w]) = ... ,<j( m+1 ^}. Let x * be the optimal 

solution of SP[w] and x* be the optimal solution of SP[w \ {6^}], so that c T x* < c T x*. If we define 
p 0 := G(x *), pi := G(x\), ..., p m+1 := G( x^ +1 ), then V := {p 0 ,Pi,p 2 , ■ ■ ■ ,P m +i} is a collection of 
to + 2 vectors in R m . By Radon’s Theorem, there exist two index sets K, L C {0,..., m + 1}, K U L = 
{0,..., m + 1}, K (~l L = 0, such that V can be partitioned into two disjoint sets Vk '■= {pk \ k £ K} and 
Vl '■= {pi | l G L}, with conv(’Pft-) nconvCPi) ^ 0. Therefore there exists p € couv(Vk) nconv(PL) C R m . 
Because p £ conv(7 - > k), there exist non-negative scalars {hk}k^K , = suc h that P — YlkeK ^ kPk■ 

Moreover, for all k £ K it holds that pjq(5^) + s(6W) < 0 VZ £ L \ {0}. Therefore, since p £ couv(Vk) 
anc l Y^keK k k = li ^ holds p T qiS 1 ' 1 ' 1 ) + s(<5 ( d) < 0 V/ £ L \ {0}. Since p also belongs to couv(Vl), we can 
analogously conclude that p T q(S ( - k ' ) ) + s(5^) < 0 Vfc £ K \ {0}. Hence, since /(UL3 {1 ,...,to + 1}, it 
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holds that p T q(S^' ) ) + s(tfW) < 0 V* £ {1,... , m + 1}. Without loss of generality, we now assume that 
0 ^ K, i.e. G(x*) Vk and let x := Yhk&K 

From the convexity of g(-,S), for every i £ {l,...,iV} it holds that g(x,S W) < '}2 k£K hkg(x k , 5«) = 
J2keK ^k [p k l .?(<^) + s (<^)] = p T (7(<5W) + s((i^) < 0, i.e., a; is a feasible point of SP[w]. Since c T x* < c T x * 
V* £ {1,..., m + 1}, we have c T x < c T x*. This, however, contradicts the fact that x* is the optimizer of 

SP[w]. □ 

Let now r > 1. From the above claim it holds that the number of support constraint for each row is 
at most m. Therefore, with rm constraints, there are at most rm support constraints. This concludes the 
proof. □ 

Proof of Lemma [7] 

The constraint G{x) q(S) + H(x) + s(S) < 0 can be expressed as g(x, <5) = G(x) q(S) + s(S) < 0 by choosing 
G(x) := [G(x) H(x)] and q(S) := [g(<S);l] £ K m+1 . Invoking Proposition [l] we immediately get at most 
r(m + 1) support constraints. □ 

Proof of Proposition [^] 

We proceed in two steps and first prove the statement. 

Claim. If r = 1, then |sc(SP[u;])| < d(d + 3)/2 + 1. 

Proof. The term 5 T A(x)5 can be equivalently written as pi(x) T qi(S) for some properly defined pi(x) and 
qi(S). Indeed, if Si is the ith component of 5 , then qi(S) contains the auxiliary uncertainties SiSj for 
i,j = 1,. ..,d. Because S^Sj = SjSi, it follows from symmetry that qi(S) G l> d ( d + 1 )/ 2 . As in the affine case, 
the remaining term b(x) T S+c(x) can be decomposed as p 2 {x) T q 2 {S) withp 2 (a^) T := [b T (x) c(x)] and Q2{5) = 
[<5; 1] G M d+1 . Hence, the constraint can be written as g(x,S) = p(x) T q(S), where p(x) := [p\(x)\p 2 (x)\ and 
q(S) := [9i(<5); 92 (<^)] £ K d ( d + 3 )/ 2+1 . The claim then follows from Proposition [I] with m = d(d + 3)/2 + 1 and 
s(S) =0. □ 

We now let r > 1. Since each constraint gt has at most d{d + 3)/2 + 1 support constraints, with r 
constraints there are at most rd(d + 3)/2 + r support constraints. □ 

Proof of Proposition [5| 

We proceed similar as in the proof of Proposition [l] 

Claim. If r = 1, then |sc(SP[w])| < m. 
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Proof (Sketch). The first part is identical to the first paragraph of the proof of the claim in Proposition [I] 
with the difference that p = J2keK ^kPk satisfies g < p T q(S^) + s(S^) < g Vi £ {1,... ,m + 1}. Moreover, 
by affinity of g mu i t (-,<5) it follows g mu it(x, <5 (i) ) = J2keK <5 (i) ) = p T g(d (i) ) + s(d (l) ), so that for 

every i £ {1,..., N} we have g < g mu it(a;, 5^) < g, i.e. a; is a feasible point of SP[w] with cost c T x < c T x*. 
This, however, contradicts the fact that x * is the optimizer of SP[w]. □ 

The proposition follows immediately since r such constraints can generate at most rm support constraints. 

□ 
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